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Abstract 

We prove that the Stanley- Wilf limit of any layered permutation pattern of 
length I is at most 4£^, and that the Stanley- Wilf limit of the pattern 1324 is at 
most 16. These bounds follow from a more general result showing that a permu- 
tation avoiding a pattern of a special form is a merge of two permutations, each 
of which avoids a smaller pattern. If the conjecture is true that the maximum 
Stanley- Wilf limit for patterns of length I is attained by a layered pattern then 
this implies an upper bound of 4^^ for the Stanley- Wilf limit of any pattern of 
length £. 

We also conjecture that, for any fc > 0, the set of 1324- avoiding permutations 
with k inversions contains at least as many permutations of length n-f 1 as those 
of length n. We show that if this is true then the Stanley- Wilf limit for 1324 is 
at most e'^V^ ~ 13.001954. 
Keywords: Stanley- Wilf limit, layered pattern 



1. Introduction 

For a permutation pattern r, let S„(t) be the set of permutations of length 
n avoiding r, and let Snij) be the cardinality of §n(T). In 2004, Marcus and 
Tardos [15| proved the Stanley- Wilf conjecture, stating that, for any pattern r, 
S,i{t) < C" for some constant C depending only on r. The limit 

L{t) = hm 5„(t)1/" 

is called the Stanley- Wilf limit for r. Arratia ^] has shown that this limit exists 
for any pattern r. 
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Marcus and Tardos's original proof gives a general upper bound for the 
Stanley- Wilf limit of the form 

L{r) < 15''^:), 
where i — \t\. This bound was later improved by Cibulka [llj to 

L{t) < 20("°s^). 

A result of Valtr presented in [l4| shows that for any pattern r of length £ we 
have L(t) > (1 - o{l))i^/e^ as £ ^ oo. 

For certain families of patterns, more precise estimates are available. An 
important example is given by the layered patterns. A permutation r is layered 
if it is a concatenation of decreasing sequences, the letters of each sequence being 
smaller than the letters in the following sequences. An example is 321465798, 
whose layers are 321, 4, 65, 7, and 98. Bona 0,11, 111 has shown that {£ - if < 
L{t) < 2'^(^) for any layered pattern t of length £. 

A motivation for the study of Stanley- Wilf limits of layered patterns stems 
from the fact that these patterns appear to yield the largest values of S'„(r) 
among the patterns r of a given length. More precisely, computer enumeration 
of Sn (t) for patterns r of fixed size up to eight and small n suggests that Sn (t) 
is maximized by a layered pattern r. This supports the following conjecture. 

Conjecture 1 (See [lo|). Among the patterns of a given length, the largest 
Stanley- Wilf limit is attained by a layered pattern. 

We remark that Bona, just after Theorem 4.6 in [l3|, presents a stronger 
version of Conjecture [1] as a 'long-standing conjecture'. The stronger conjecture 
states that the maximum for L(t) over all r of a given length i is attained by 
1 © 21 ® • • • ® 21 ® 1 or 1 ® 21 ® • • • ® 21, depending on whether £ is even or odd. 

Two patterns t and a are Wilf equivalent if Snir) = Snic) for all n. If r is 
of length three, then S'„(r) is the nth Catalan number, and so L{t) = 4. For 
patterns of length four there are three Wilf (equivalence) classes, represented by 
1234, 1342 and 1324. Regev ^ proved that L(1234) = 9 and, more generally, 
that L(12 ■■■£) = {£- 1)^. Bona 01 proved that L(1342) = 8. In fact, exact 
formulas for S'„(1234) and S'n,(1342) are known, the first one being a special case 
of such a result for the increasing pattern of any length, established by Gessel 
13 1, the second one obtained by Bona 

The last Wilf class of patterns of length 4, represented by the pattern 
1324, has so far resisted all attempts at exact enumeration or exact asymp- 
totic formulas. A lower bound was found by Albert et al. [l"|, who showed that 
S'„(1324) > 9.47". In particular, that disproved a conjecture of Arratia [3] that 
for any pattern t of length £, L{t) is at most {£ — 1)^. 

As far as we know, the best published upper bound so far for L(1324) is 288, 
proved by Bona 



•^In an earlier version of the proof 0|, Bona claims that L(1324) < 36, but the argument 
appears flawed. 
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In this paper, we present a general method that allows us to bound the 
Stanley- Wilf limit of an arbitrary layered pattern, and which may also be used 
for non-layered patterns of a special form. In particular, for an arbitrary layered 
pattern r of length we prove the bound L{t) < 4£^, improving Bona's bound 
of 2^^^\ Our bound is sharp up to a multiplicative constant, since (£ — 1)^ < 
L{t). If Conjecture [T] holds, then this result has the following consequence, 
which we state as a separate conjecture. 

Conjecture 2. For any pattern r of length £, we have L{t) < 4^^. 

For some specific patterns, we are able to give better estimates. Notably, we 
are able to show that L(1324) < 16. These results appear in Section [2j 

In Section [31 we investigate an approach that may lead to a further im- 
provement of our bounds, based on the analysis of pattern-avoiding permuta- 
tions with a restricted number of inversions. For a pattern r, let §^(t) be the 
set of 1324-avoiding permutations of length n with exactly k inversions, and 
let S'^(t) be its cardinality. We conjecture that for every n and k, we have 
S',';(1324) < S'^_^i(1324). We prove that if this conjecture holds then 

L(1324) < e'^Vy^ ~ 13.001954. 

In the last section, we extend our considerations to more general patterns. 
We conjecture that the inequality S^{t) < S^^_^_l{T) is valid for any pattern r 
other than the increasing patterns. As an indirect support of this conjecture, 
we describe how the asymptotic behavior of S^{t) for k fixed and n going to 
infinity depends on the structure of t. 



2. The Stanley-Wilf limit of 1324 is at most 16 

Let us begin by recalling some standard notions related to permutation pat- 
terns. Two sequences of integers oi • • • and bi ■ ■ ■ bk are order-isomorphic if 
for every i,j g {1, . . . , fc} we have Oi < Oj ^ bi < bj. We let S„ be the set of 
permutations of the letters {1, 2, . . . , n}. For a permutation tt S S„ and a set 
/ = {ii < 12 < ■ ■ ■ < ik} ^ {1, • . • , n}, we let 7r[/] denote the permutation in 
§k order-isomorphic to the sequence 7r(ii)7r(i2) • • • 7r(ifc). A permutation vr G S„ 
contains a permutation a G if tt[I] — a for some /. In such context, a is 
often called a pattern. 

We say that a permutation tt G is a merge of two permutations ct G S/j 
and T G §n-k if there are two disjoint sets / and J such that /UJ = {l,...,n}, 
Tr[I] = a and 7r[J] = t. For example, 3175624 is a merge of cr = 132 and 
r = 1423 with / = {1,3,4} and J = {2,5,6,7}. 

For a pair of permutations cr G Sfc and r G their direct sum, denoted by 
a © T, and their skew sum, denoted by cr G t, are defined by 

/ ii i < k , , \(7(i)+£ if i < k 

{a®T){t) = < , , . ~ and {(7eT){t) = < , , . ~ 

I T[i — k) + k ii i > k I T[i — k) ii i > k. 
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For example, 23103142 = 2316475 and 23103142 = 6753142. A permutation is 
decomposable if it can be written as a direct sum of two nonempty permutations, 
otherwise it is indecomposable. Every permutation tt can be uniquely written as 
a direct sum (possibly with a single summand) of the form tt = ai • • • a„i, 
where each summand aj is indecomposable. The summands ai., . . . ,am are 
the components of tt. For example, the permutation 31425786 is decomposed 
as 31425786 = 3142 1 231, which means that it has three components, 
corresponding to 3142, 5 and 786. 

The key tool in our approach is the next lemma, which shows that a permu- 
tation avoiding a pattern of a particular kind is a merge of two permutations, 
each of them avoiding a smaller pattern. 

Lemma 3. Let a, t, and p be three (possibly empty) permutations. Then every 
permutation avoiding a (B (t Q 1) (B p is a merge of a permutation avoiding 
(T ® (t 1) and a permutation avoiding (r 9 1) p- 

Proof. We may assume that a and p are nonempty, otherwise the lemma holds 
trivially. Let tt = tti • • • 7r„ be a permutation. Successively color the tt^, in the 
order tti, 7r2, . . . , 7r„, red or blue according to the following rule: 

If coloring irt red completes a red occurrence of cr ® (r 1), or if 
there already is a blue element smaller than tTj, then color tt, blue; 

otherwise color tt^ red. 

Note that the first element, tti, will always be colored red. Further, the red 
elements clearly avoid cr © (r 1) . We claim that if tt avoids cr0(r0l)0p then 
the blue elements avoid (T0l)0p, and we proceed by proving the contrapositive 
statement. Assume that there is a blue occurrence of (r 1) p. Let tb, 1b, 
and be the three sets of blue elements corresponding to the three parts r, 
1 and p forming the occurrence. In particular, 1b contains a single element, 
which will be denoted by tt*. 

Fix a blue element tt^ such that s < t, tTs < wt, and tt^ is as small as possible 
with these properties. This means that tt^ was colored blue for the reason that 
coloring it red would have completed a red occurrence of C7 (r 1). Therefore, 
TTg is the rightmost element of an occurrence of a® (t0 1), and all other elements 
of this occurrence are red. Let an and tr be the sets of elements corresponding 
to a and r in this occurrence. 

We now distinguish two cases depending on the relative position of tb and 
(TR. If all the elements of precede all the elements of tb (including the case 
T — 0), then U Tb U Is U pb forms an occurrence of a (r 1) p. This 
is because each element of an is smaller than tts, which, in turn, is at most as 
large as ttj. 

Suppose now that at least one element of is to the right of the leftmost 
element of tb- Then all the elements of tr are to the right of the leftmost 
element of tb • Consequently, all the elements of tr are smaller than the leftmost 
element of tb, otherwise they would be blue. Therefore all elements of tr are 
smaller than any element of ps, and aaU trU {tTs} D Pb is an occurrence of 
(T (r 1) p. □ 
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T he sp ecial case r = 0, in the lemma above, corresponds to an argument by 
Bona [10|. More importantly, for our purposes, the special case a = t = p = 1 
gives a representation of any 1324-avoiding permutation as a merge of a 132- 
avoiding permutation and a 213-avoiding permutation. For instance, coloring 
the 1324-avoiding permutation 364251 we find that the red and blue elements 
are 3621 and 45, respectively. 

To apply Lemma [31 we need an estimate on the number of permutations 
obtainable by merging two permutations from given permutation classes. A 
permutation class is a set of permutations C that is down-closed for the con- 
tainment relation, that is, if t G C and r contains ct, then cr G 6. The growth 
rate of C is defined as limsup„_j.oc |C n §„|^/". As pointed out by Arratia 
if C = S(t) is a principal class, that is, 6 is the set of permutations avoiding a 
single pattern r, then the limsup is actually a limit, and the growth rate of C 
is the Stanley- Wilf hmit L(r) of r. 

In the following lemma we adapt an argument that has been used by Bona [l3| 
in a less general setting. 

Lemma 4. Let A, 2?, and 6 be three permutation classes with growth rates a, 
P and 7, respectively. If every permutation of 6 can be expressed as a merge of 
a permutation from A and a permutation from 23, then 

V7 < + V^- 

Proof. Let a„, 6„ and c„ be the numbers of permutations of length n in ^1, 
23 and C, respectively. For every e > 0, we may fix a constant K such that 
an < Ka'^il + £)" and 6„ < Kl3''{l + e)" for each n. 

There are at most (^) possibilities to merge a given permutation of length 
k with a given permutation of length n—k, because we get to choose k positions 
and k values to be covered by the first permutation. We thus have 

" / \ 2 

< K\l + e) 

<K\l + e) 

< K^{l + e) 

which implies that 7 is at most {y/a + \/]3)'^, as claimed. □ 

Taking o' = r = p= lin Lemma|3l using the fact that L(132) = L(213) — 4, 
and applying Lemma |4j we get the following result. 

Corollary 5. The Stanley- Wilf limit of 1324 at most 16. □ 



k on—k 



k^O 



E 

k^O 



n 



E 



n\ ^ — k /t;"-*^ 



k=0 
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We may apply Lemmas [3] and S] to get an upper bound for the Stanley- Wilf 
limit of any layered pattern. Let 0"! denote the identity permutation 12 • • • n, 
and let G"! denote its reverse n • • • 21. By a result of Backelin, West and Xin Q|, 
we know that for arbitrary ct, the pattern (©"1) © cr is Wilf equivalent to the 
pattern (©"1) © cr. 

Let a{£i,£2, ■ ■ ■ ,£m) denote the Stanley- Wilf limit of the generic layered 
permutation (©^U) © (©^n) © • • • © (©^"1). 

Lemma 6. For any positive integers £i, . . . , i„i, we have 

Cm— 1 
£i + f ™ - m + 1 -I- 2 ^ 
i=2 

Proof. We proceed by induction on m. For m < 2, the bound follows from the 
known fact [l^ that ©'^1 has Stanley- Wilf limit (fc — 1)^. Assume now that 
m > 3. Combining Lemma [3] and Lemma |31 we see that 

< \/a(^i,^2) + V«(^2,...,0 

Cm— 1 

which gives the desired bound. □ 
Corollary 7. A layered permutation of length i has Stanley- Wilf limit at most 

As we pointed out in the introduction, any layered pattern of length £ has 
Stanley- Wilf limit at least {£ — 1)'^, so the quadratic bound in the previous 
corollary is best possible. 




3. On 1324-avoiding permutations with a fixed number of inversions 

An inversion in a permutation vr = 7ri7r2---7r„ is a pair {i,j) such that 
^ i < j l£ n and TTi > iTj. The number of inversions in tt is denoted lNV(7r). 
In this section we will consider the distribution of inversions over 1324-avoiding 
permutations. We will show that a certain conjectured property of this distri- 
bution implies an improved upper bound for L(1324). Recall that S^{t) is the 
number of T-avoiding permutations of length n with k inversions. 

To illustrate our approach, and to introduce tools we use later, we will first 
derive an upper bound on L(132) (even though we know that L(132) — 4). Here 
are the first few rows of the distribution of inversions over S(132), where the 
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fcth entry in the nth row is the number 5^(132): 




112 1 

1^^^^^^^^^ 3 3 3 1 

■■■^^5 7 7 6 4 1 

PHHHHH 9 11 14 16 16 17 14 10 5 1 

1 1 2 3 5 7 11 13 18 22 28 32 37 40 44 43 ... 

^^^^^^^ 20 26 34 42 53 63 73 85 ... 

We make two observations: (1) the columns are weakly increasing when read 
from top to bottom; (2) each column is eventually constant, as shown by the 
grayed area. If we can prove this and give a formula for the eventual value c{k) 
of the fc-th column, then we can bound 5„(132) by X]fe<(") c{k). For instance, 

54(132) < 1 + 1 + 2 + 3 + 5 + 7 + 11 = 30. 

To prove that the columns are weakly increasing is easy: the map tt tt ® 1 
from §„_i(132) to S„(132) is injective and inversion-preserving. Our goal is to 
show that each column is eventually constant and to find the formula for the 
eventual value of A;-th column. 

Lemma 8. Let tt e and let c be the number of components of n. Then 

iNv(7r) >n-c. 

Proof. We use induction on n. The case n = 1 is trivial. Assume n > 1 and 

write TT as the sum of its components tt = ai • • • ac. Note that if (i, j) is an 
inversion in tt = 7ri7r2 • • • 7r„ then tt^ and ttj must belong to the same component 
of TT. Thus, if c > 1, we have 

lNV(7r) = iNV(ai) H h iNV(ac) 

> |ai| — 1 H + jad — 1 by induction 

= n — c. 

Assume then that c = 1 and let i be the position of n in tt, that is, tt^ — n. Also, 
let a € §n-i be the permutation obtained by removing n from tt. Although 
a can be any permutation, the number i has some restrictions. Obviously, 
i < I (J I = n — 1, since if i = n, then n would constitute a component of its own, 
contradicting the assumption that c = 1. More generally, if we decompose a 
into its components 

CT = /3i © • • • © /3d, 



7 



then we see that i< Thus 



lNV(7r) = iNV(a-) +n — i 
> \(7\ — d + n — i 



by induction 
since |(t| — n — 1 
since n — d> |/3i| 
since i < 



>n-l-i + \/3i\ 
> n- 1, 



as claimed. 



□ 



Definition 9. The inversion table of a permutation tt = tti • • • 7r„ is the se- 
quence bib2 ■ ■ ■ bn, where bi is the number of letters in tt to the right of tt^ that 
are smaller than tt.;. 

For example, the inversion table of 352614 is 231200. Clearly, the number of 
inversions in a permutation equals the sum of the entries in the inversion table. 
It is also easy to see that the map taking a permutation to its inversion table is 
a bijection. In other words, a permutation can be reconstructed from this table. 

Lemma 10. A permutation avoids the pattern 132 if and only if its inversion 
table is weakly decreasing. 

Proof. Let tt — 7ri7r2 ■ ■ • 7r„ be a permutation with inversion table bib2 ■ ■ ■ bn. 
Suppose that hi < bi+i for some i. Then we must have tt^ < vTi+i, and the 
number of letters to the right of tt^+i that are smaller than tt^+i is greater than 
the number of such letters that are smaller than tt^ . Thus there is a j > i + 1 
such that TTi < TTj < -Ki+i- But then TTiTTi+iTTj form the pattern 132. 

Conversely, assume that ■Ki'Kj'Kk is an occurrence of 132 in tt, and assume 
that the occurrence has been chosen in such a way that the index i is as large 
as possible. This choice implies that 7r,;+i is greater than TTfc, and consequently, 
>h. □ 

A partition of an integer /c is a weakly decreasing sequence of positive integers 
whose sum is k. By dropping the trailing zeros from the inversion table of a 
permutation tt S Sj"j(132) we obtain a partition A of k. We then say that A 
represents tt. For instance, the inversion table of tt = 65723148 is 5441100, so tt 
is represented by the integer partition 5+4 + 4 + 1 + 1. Two distinct 132-avoiding 
permutations of the same size are represented by distinct integer partitions. On 
the other hand, a permutation tt e §„(132) is represented by the same partition 

as TT © 1. 

In any 132-avoiding permutation vr, only the first component may have size 
greater than 1, so tt has a decomposition of the form cr+l + l®---®! where a 
is an indecomposable permutation represented by the same partition as vr. It is 
easy to see that a partition A of an integer k represents a unique indecomposable 
permutation a, and by Lemma [51 a has size at most fc + 1. Consequently, for 
every n> fc + 1, A represents a unique permutation tt of size n. This yields the 
following result. 
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Proposition 11. For every k < n, we have S',^(132) = p{k), where p{k) is the 
number of integer partitions of k. 

The following rather elementary upper bound for p{k) can, for example, be 
found in [3, pp 316-318. 

Lemma 12. Let p{k) be the number of integer partitions of k. For k > we 
have 

p{k) < p^, 

where p = e'^^ ~ 13.001954. 
Letting m = (2), we thus have 

5„(i32) = ^nim < (™ + ^)sz+i 

/ 2(m+l) 

= (to + 1)p(to + 1) < (m + l)e''V 3 ^ 

and 

L(132) = lim (5„(132))i/» < hm (nV2 + 0(n))'/" e" 

n— J-oo n— J-oo 

= ~ 6.1337. 

We have now seen that counting 132-avoiding permutations with relatively 
few inversions leads to an upper bound for L(132). Can we similarly bound 
L(1324)? These are the first few rows of the distribution of inversion over 
§(1324): 



1 
1 


1 
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1 
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1 
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5 


10 


16 


20 


20 


15 


9 


4 


1 
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2 


5 


10 


20 


32 


51 


67 


79 


80 


68 


49 


29 . 


1 


2 


5 


10 


20 


36 


61 


96 


148 


208 


268 


321 


351 . 


1 


2 


5 


10 


20 


36 


65 


106 


171 


262 


397 


568 


784 . 
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2 


5 


10 


20 


36 


65 


110 


181 


286 


443 


664 


985 . 


1 


2 


5 


10 


20 


36 


65 


110 


185 


296 


467 


714 


1077 . 


1 


2 


5 


10 


20 


36 


65 


110 


185 


300 


477 


738 


1127 . 


1 


2 


5 


10 


20 


36 


65 


110 


185 


300 


481 


748 


1151 . 



Again, it seems as though (1) the columns are increasing when read from top 
to bottom; (2) each column is eventually constant. Unfortunately, we have not 
been able to show that the columns are increasing, but we conjecture that they 
are: 
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Conjecture 13 (Increasing columns). For all nonnegative integers n and k, we 
have 5,^(1324) < S',';+i(1324). 

We are, however, able to say what the fixed sequence is. First we need some 
lemmas. 

Lemma 14. //tt e 5,^(1324) and k <n - 1, then 



for some nonempty permutations a G S(132) and t G §(213). 

Proof. Let c be the number of components in tt, and write tt = ai © • • • ® ac- 
Since fc < n — 1 it follows from Lemma [S] that c > 2. There can be no inversions 
in 77 except within the first component and within the last component, since 
otherwise we would have an occurrence of 1324; thus a2 ~ ■ ■ ■ = olc-i = 1- 
Since the letters in the first component have a larger letter to their right, the 
first component must avoid 132 (so that tt avoids 1324). Likewise, the last 
component must avoid 213. □ 

Let 7{m) be the set of partitions of an integer m, and let Q(m) be the set 



Proposition 15. For k < n — 1, there is a one-to-one correspondence between 
S^(1324) and Q{k). 

Proof. Fix k < n — 1 and choose tt G Sjj(1324). Let c be the number of compo- 
nents in TT, and write vr = ai © a2 ® • ■ ■ ® ac, where each ai is nonempty. By 
Lemma [Ml we have that ai G §(132), ac G §(213), and a2 = ■ ■ ■ — ctc-i — 1- 
Let a — ai and r = Let i = INV((t), and j = INV(t). Note that i + j = k. 

Let i be the length of r and let r' be the reverse-complement of r, that 
is, Tj' = £ -\- i — Ti+i-i for i = 1, . . . Then r' is an indecomposable 132- 
avoiding partition with j inversions. Let A G J'(i) and ji G J'(j) be the partitions 
representing a and r', respectively. We then let (A, ^i) G Q(fc) be the image of tt. 

To see that this is a bijection, choose a pair (A,/i) G Q(fc). Let i be the 
sum of A and j the sum of /i. Let a and r' be the unique indecomposable 
132-avoiding permutations represented by A and /i. respectively. Let t be the 
reverse-complement of t'. We have n > /c -t- 2 = (i -I- 1) + (j -I- 1) > |cr| -I- |t|. We 
can therefore construct a permutation tt = cr © (©"~I'"|-I^ll) © r, which is the 
preimage of (A, /i). □ 

Lemma 16. Let p be as in Lemma \JM Then, for k > 0, 



7r = cr©l©---©l©T 



{{X,^l)■. AgT(i), MeT(j), z+j = m}. 
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Proof. We have 

k k 

\Q{k)\ = '^p{i)p{k - i) < ^pV^+^*^ by Lemmain] 

k 
i=Q 

as claimed □ 

Theorem 17. // Conjecture[W\is true, then the Stanley- Wilf limit for 1324 is 
at most p = e'^Vi ~ 13.001954. 

Proof. With m = (2) we have 

m m 

S'„(1324) = S',';(1324) < ^ S',';,+2(1324) by Conjecture [H 

m 

= ^|Q(fc)| by Proposition [15] 

k=0 
m 

<^(fc + l)p^ byLemmaim 

k=0 

< (TO + l)(m + l)p^ 



fc=0 i;=0 



= 1(^2 - n + 2)V"^^"^/". 
On taking the nth root and letting n ^ 00, the result follows. □ 



4. Generalizations 

We have seen that the conjectured inequality £','^(1324) < S'^_,_j^(1324) implies 
an estimate on L(1324). Let us now focus on the behavior of S^{t) for general 
patterns t. Let us say that a pattern r is WV-monotone if for every n and every 
k, we have the inequality S^{t) < S!^_^_l{T). 

Recall that ®^1 is the identity pattern 12 ■ ■ ■ £. Let us first observe that a 
pattern of this form cannot be iNV-monotone. 

Lemma 18. For any k and for any n large enough, we have S'^(©^1) = 0. In 
particular, 0^1 is not INV-monotone for any £ > 2. 

Proof. For n > (£ — l)(fc + 1), a well-known result of Erdos and Szekeres [l^ 
guarantees that any permutation of length n has either an increasing subse- 
quence of length £ or a decreasing subsequence of length k-\-2. Therefore, there 
can be no ©^1-avoiding permutations of length n with k inversions. □ 
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On the other hand, some patterns are iNV-monotone for trivial reasons, as 
shown by the next lemma. 

Lemma 19. Let t = T1T2 ■ ■ ■ rp he a pattern such that ti > I or Tg < £. Then 
T is INV-monotone. 

Proof. Suppose that ti > 1. It is plain that tt i— > 1 tt is an injection from 
§Jj(r) into §Jj^]^(r), demonstrating that Sj^{t) < Sj^^i{t). The other case is 
symmetric. □ 

We are not able to characterize the INV-monotone patterns. Based on nu- 
merical evidence obtained for patterns of small size, we make the following 
conjecture, which generalizes Conjecture 1131 

Conjecture 20. Any pattern r that is not an identity pattern is INV-monotone. 

Another source of support for Conjecture [201 comes from our analysis of 
the asymptotic behavior of S','J(t) as n tends to infinity. To state the results 
precisely, we need some definitions. 

A Fibonacci permutation is a permutation tt that can be written as a direct 
sum TT = Qfi ® a2 ® • • • © am where each ai is equal to 1 or to 21. In other words, 
a Fibonacci permutation is a layered permutation whose every layer has size at 
most 2. 

Proposition 21. Let t be a Fibonacci pattern with r > 1 inversions. For every 
k > r, there is a polynomial P of degree r — 1 and an integer uq = ?io(fc,T), 
such that S^{t) = P{n) for all n> uq. 

Proof. We first observe that an arbitrary permutation tt can be uniquely ex- 
pressed as a direct sum (possibly involving a single summand) of the form 

TT = ao ® /3i ® ai ® /32 © • • • © /3m © a„, 

where m > is an integer, each at is a (possibly empty) identity permutation, 
and each /3i is an indecomposable permutation of size at least two. For instance, 
if TT = 124365, we have ao = 12, ai = a-z = 0, and /3i = /?2 = 21. We will call the 
sequence (/3i, . . . , the core of tt, and the sequence (ao, . . . , a„i) the padding 
of TT. The sequence of integers (|ao|, . . . , \ am\) will be referred to as the padding 
profile of tt. Of course, the padding is uniquely determined by its profile, and 
the permutation tt is uniquely determined by its core and its padding profile. 

Let T be a Fibonacci pattern with r inversions. Note that this is equivalent 
to saying that r is a permutation whose core consists of r copies of 21. Let £ be 
the length of r. Let us fix an integer k > r and focus on the values of S^{t) as 
a function of n. 

Note that the core of a permutation vr with iNv(7r) = k can have at most k 
components. Moreover, each component of the core of tt has size at most fc + 1, 
otherwise tt would have more than k inversions by Lemma [S] In particular, 
the permutations with k inversions have only a finite number of distinct cores. 
Define S'^Xr) = lJri>i (''')• Let C be the set of all the distinct cores formed by 
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members of S'^(t). Let §„ (r) be the set of permutations from §^(t) whose core 
is equal to c, and let Sn^r) be its cardinahty. Clearly. S^{t) = J2cec ^nHr). 
To prove our proposition, it is enough to prove the following three claims: 

1. There is a constant 7 = j{k, r) such that 5','J(t) > 777/'^^ for every n. 

2. For every c G C, there is a constant d = S{k,c,T) such that 5,t'(r) < 

3. For every c G C, there is a polynomial Pc and a constant ric such that 
Sn^T) — Pc{n) for every n > 71^- 

To prove the first claim, we consider the set of all permutations with core 
c = (/3i, /32, . . . , Pr-i), where /3i = 1 G (e'^-'^+^l) = {k-r + 3)12 • • • (fc - r + 2), 
and = Pa = ■ ■ ■ — Pr-i —21. Note that any permutation with core c has 
exactly k inversions and avoids r. The padding profile of such a permutation is 
a sequence of r nonnegative numbers whose sum is fi — X]i=i = n— k — r + 1. 
The number of such sequences is ("Zi) > which gives the claimed bound. 

To prove the second claim, fix a core c = . . . , /3m) G C, and define t = 
X^i^i lAI- Assume that m> r, otherwise there are only 0(n'"~^) permutations 
with core c and the claim is trivial. Let tt be a permutation with core c, and let 
a = (oq, . . . , am) be the padding profile of tt. Observe that if a has more than 
r integers greater than £, then tt must contain t. Thus, Sn^ (r) can be bounded 
from above by the number of all the padding profiles of sum n ~ t and with at 
most r components greater than £. The number of such padding profiles may 
be bounded from above by {"ZD : proving the second claim. 

To prove the last claim, we reduce it to a known property of down-sets of 
integer compositions. Let Np be the set of d-tuples of non-negative integers. 
Fix a core c = . . . , G C. Let a(7r) denote the padding profile of a 
permutation tt. Define the sets An — {o-(ti) : vr G and A = Un>o^n- 

Define a partial order < on N™^^ by putting (oq, . . . , am) < (&0: ■ • ■ : ^m) if for 
every i G {0, . . . ,to} we have ai < bi. Note that for two permutations a and 
TT with core c, a is contained in tt if and only if a{a) < a(7r). In particular, 
the set A is a down-set of N™^^, that is. if a belongs to A and b < a, then 6 
belongs to A as well. To complete the proof, we use the following fact, due to 
Stanley 

Proposition 22 (Stanley). For every d, if D is a down-set in Nq and D{n) is 
the cardinality of the set {(ai, . . . , a^) & D : ai -\- ad — n}, then there is a 

polynomial P such that D{n) — P{n) for all n sufficiently large. 

From this fact, we directly obtain that \An\ is eventually equal to a polyno- 
mial, and therefore S',t'(r) is eventually equal to a polynomial as well. □ 

Let P{n) be the polynomial from Proposition [5T] We note that if r = ©^1, 
then P{n) is the zero polynomial by Lemma \TE[ if r = 132, then P{n) — p(k) 
by Proposition [m and if r = 1324, then P{n) = |Q(fc)| by Proposition [T51 It 
would be interesting to know what P{n) is for other Fibonacci patterns. 
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The conclusion of Proposition [3T] cannot be extended to non-Fibonacci pat- 
terns, as shown by the next proposition. 



Proposition 23. Let t he a non-Fibonacci permutation. For every k there 
exists a polynomial P of degree k and an integer uq such that for every n > Uq, 
S^{t) = P{n). Moreover, P(n) = n^/k\ + 0{n'^~^). 

Proof. We can show that S'^(t) is eventuahy equal to a polynomial P by the 
same argument as we used in the proof of Proposition 12 II It is therefore enough 
to provide upper and lower bounds for S^(t) of the form ^ -|- 0(n'^~^). To 
get the upper bound, note that the number of all permutations of length n 
with k inversions is at most ("^^~^), as seen by encoding a permutation by 
its inversion table. For the lower bound, note that r is not contained in any 
Fibonacci permutation, and the number of Fibonacci permutations of length n 
with k inversions is precisely ("^'^) ■ □ 

Propositions [3T] and [231 imply that for any pattern r, any k and any n large 
enough, we have S^^{t) < S^_^_i{t), which corresponds to an 'asymptotic version' 
of Conjecture 1201 The two propositions also imply a sharp dichotomy between 
Fibonacci and non-Fibonacci patterns, in the sense of the next corollary. 

Corollary 24. Let S^^ be the number of all permutations of size n with k in- 
versions. Let T be a pattern with r inversions. Define 

Q{k,T)^ hm %i 

as the asymptotic probability that a large permutation with k inversions avoids t. 
If T is a Fibonacci pattern and k > r, then Q(k,T) = 0. In all other cases 

Q(fc,T) = l. 
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